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. Abstract 

. In this paper we find asymptotic distribution for some unreliable networks. Using Markov 

Additive Structure and Adan, Foley, McDonald [T] method, we find the exact asymptotic for 
. the stationary distribution. With the help of MA structure and matrix geometric approach, 

p I I we also investigate the asymptotic when breakdown intensity is small. In particular, two dif- 

ferent asymptotic regimes for small breakdown intensity suggest two different patterns of large 
deviations, which is confirmed by simulation study. 
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^ ■ 1 Introduction 
l> 
O 

' In this paper we consider problem of finding an exact asymptotic of some non-standard queueing 
'nI" ' systems. We consider two models: Model 1 is an unreliable M/M/1 system, and Model 2 is a 
. system consisting of 2 servers: server 1 being unreliable and server 2 reliable one with a possible 
feedback from server 1 to 2. There are a lot of practical problems modelled as Markov chains using 2 
or 3 variables. Explicit formulas for stationary distribution can be found only in some special cases. 
That is why studies on asymptotic for such stationary distributions have been actively conducted 
L ^ , by theoretical- and application-oriented researches. There are several techniques available, starting 
r> ■ with matrix geometric approach (Neuts, [9]), matrix analytic method (for recent related work see 
. Liu, Miyazawa, Zhao [6J, Miyazawa, Zhao [8] and Tang, Zhao [12]) or a method of Adan, Foley, 
McDonald [l\ which we are going to use widely in this paper. 

To describe our results, let us start with a brief description of the models. In the unreliable 
M/M/1 system, the customers arrive according to a Poisson process with intensity A and are served 
with intensity Moreover, there is an external Markov process which governs the breakdowns 
and repairs: with intensity a the server can change status from Up to Down, and with intensity 
/3 vice-versa. While server is in Down status, customers are no longer served, but new ones can 
join the queue at the server. 

Model 2 consists of two servers: Customers arrive to the server 2, which is reliable, according 
to a Poisson process with intensity A and after being served they are directed to the unreliable 
server 1 which is as the one described above. The service rate at both servers is fi. After being 
served at server 1 the customer leaves the network with probability p and with probability 1 — p 
is rerouted back to the queue at server 1. 

The situation described above is different than the loss regime. In this regime, customers 
arriving when a server is in Down status, are lost (to the Down server). In Sauer and 
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Daduna showed that under this regime the stationary distribution of network of unreHable servers 
is of product form: the stationary distribution of a pure Jackson network and the stationary 
distribution of the breakdowns/repairs process. In such a network when customer arrives while 
server is in Down status, it is lost to the server, but not to the network: it is rerouted - according 
to some routing regime - to some other server which is in Up status. 

However, if a customer can join the queue while the server is broken, then the stationary 
distribution is not of product from, as can be seen in White and Christie |13j . There, the authors 
give the stationary distribution of Model 1 only. For the Model 2 we are not aware of any results, 
neither exact distribution, nor asymptotic one. 

In our paper, we give exact asymptotic for both models, following the method of Adan, Foley, 
McDonald [Ij. Using Markov Additive Process approach we can clearly show all the differences 
between two models. 

We also consider the behaviour of the "limiting system", i.e. the system in which the breaking 
probability a goes to 0. From the method of the above authors we are able to conclude the exact 
asymptotic of such "limiting system" , but only for Model 1 and for some set of parameters: when 
fi < X + f3. It turns out to be the same (up to a constant) as the stationary distribution of a 
M/M/1 queue. For the other set of parameters (/i > A + /3), this method does not lead to a 
valid asymptotic. However, using the matrix geometric approach (Neuts, [9]) we show that then 
the "limiting system" for Model 1 still has the same (up to a constant) stationary distribution as 
M/M/1 queue. The matrix geometric approach, however, does not give us any information about 
constants. Nevertheless we conclude two different ways in which the system can accumulate a big 
number of customers. When /i < A + /3, then in most cases a path leading to a big queue is to be in 
Up status, and to accumulate a big number of customers, exactly like in standard M/M/1 queue 
(the system does not manage to service customers). The breakdowns/repairs of the system do not 
have big influence on large deviations. However, if > A + /3, then in most cases a big number of 
customers is accumulated while the system is in Down status. We illustrate it with simulations 
(for small a), see Figure [Hand description on page [6] for details. 

Furthermore, for Model 2 the method of Adan, Foley, McDonald [1] does not lead to a valid 
asymptotic for the "limiting system" . Also, matrix geometric approach is not applicable. 

For the related work, but using different technique see for example Liu, Miyazawa, Zhao [6], 
Miyazawa, Zhao ^ and Tang, Zhao [12l- Authors therein use matrix analytic method. It uses the 
fact that some stationary distributions can be presented in matrix form and shown to be solutions 
of Markov renewal equation, this way decay rates are considered. 

In Section 2 we give detailed description of both models, present and discuss all the results. 
The proofs are in Section 3. 

2 Unreliable server systems and results 
2.1 Description of systems 

Model 1 is a following system consisting of 1 server: customers arrive according to an external 
Poisson arrival stream with intensity A and are served according to the First Come First Served 
(FCFS) regime. Each of them requests a service which is exponentially distributed with mean 1. 
Service is provided with intensity fi. There is an external process on the state space {Up, Down}: 
with intensity a the server changes status form Up to Down and with intensity /3 from Down to 
Up; Down-to-Up and Up-to-Down times are exponentially distributed. When the server is broken 
it immediately stops service, the customer being served is redirected back to the queue. When a 
new customer arrives while the server is in the Down status, it joins the queue at the server. We 
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assume that all service times, inter-arrivals time, Down-to-Up and Up-to-Down times constitute 
an independent family of random variables. If number of customers is strictly positive, then the 
transition intensities are as depicted in Figure [TJ 




A 



Figure 1: Transitions of Model 1: Unreliable single server. 

Otherwise, if the number of customers is 0, then the transition intensities are similar, except there 
is no transition from (0, Up) to (—1, Up). 

Model 2 consists of 2 servers. The customers arrive to the reliable server 2 according to a 
Poisson process with intensity A and are served there with intensity ^. After being served they 
are directed to the unreliable server 1, which is exactly unreliable single server system described in 
Model 1. The service intensity at both systems is /x. After being served at server 2 the customer 
leaves the network with probability p and with probability 1 — p it is rerouted back to join the 
queue at server 2. The system is depicted in Figured 



l-p 



A 




server 2 server 1 



Unreliable 
Figure 2: Model 2. 

Let X^-^\t) denotes the number of customers present at the server in Model 1 at time t > 0, 
either waiting or in service, and let a{t) S {Up, Down} denotes the status of the server. Similarly 
for Model 2: X^'^\t) denotes the number of customers present at server 1, Y^'^\t) the number 
of customers at server 2 and a{t) the status of the unreliable server 1, all at time t > 0. We 
denote the process of Model 1 by Z^^) = , cr(t)), t > 0} and the process of Model 2 by 

Z(2) = {(X(i)(2),y(2)(t),cj(t)),t > 0} . The state space of Z^^) is E^^'^ = {{x,a), x G N, cj G 
{Up, Down}} and the state space of Z^^^ is i?^^-* = {{x,y,a), x,y £ N, a £ {Up, Down}}. In 
the following, the superscripts denote that constant/number is associated with Model 1 or 

Model 2 respectively. To have concise notation, we identify {Up, Down} with {U,D}. 
Throughout the paper we assume that p > and that the system is not trivial, i.e. 

A > 0, /i > 0, a > 0, /3 > 0. 
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Moreover we assume that 

^ < (1) 

a + p 

which imphes that both systems are stable (for Model 1 we mean that condition holds with p = 1). 
Actually for Model 1 and for Model 2 with p = 1 it is "if and only if" condition. See Lemma 13.11 
for details. 

We can consider -^^^l^ as the effective service rate of the unreliable server. Stability in this 
case means that we have the unique stationary distribution, which we denote by vr. It will be clear 
from the context whether tt is associated with Model 1 or Model 2. 

By Tik ~ rrik we mean that nk/mrik — ?• 1 as /c — )• oo. In this paper, "the exact asymptotic of 
vr" means deriving an asymptotic expression for TT{k,a) (Model 1) or TT{k,y,a) (Model 2), that is, 
deriving an expression of the form Tr{k,a) ~ or TT{k,y,a) ~ gk- 

It is convenient to define some constants in this place. Let Sp = {fip — A — /3 — a)^ + Aafxp. 
Define also 

2A 

~ X + /3 + fip + a-^ ^ ( ' ) 

and 

^ _ / A + /3-/u-a + ^ ^ 2a(3 



X + /3 - 12- a + -y/sl 

2.2 Results for Model 1 

Our first result is following. 

Proposition 2.1. Assume that ^^ holds with p = 1. For the unreliable server system (Model 1) 
we have 



7r{k,Up) ~ C7W(C/p)7^, 

Tr{k,Down) ~ C^^\Down)-f^ , 

where 

d^^-* is defined in and rj^^'^ is equal to rj in defined for appropriate process. 

Remark: Comparison with standard M/AI/1. Consider standard M/M/1 queue with arrival 
and service intensities Aq, /^o given by Aq = A, /^q = i-e- both systems have the same effective 

rates. We can compare the behaviour of both system for large number of customers k. For the 
M/M/1 system, the stationary distribution ttq is known exactly: 



^o(0 = ^o(O) f 



/^o-AoVA*oy /3/i - (a + /3)A V 



Elementary calculation shows that under ([T]) with p = 1 

2A a + /3 A 



71 



> 



A + /3 + a + /i-y^ /3 11 
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It means for big k, that vro is stochastically greater than vr. We also note that for ttq only the ratio 
of a + 13 and /3 matters, but this is not true for tt. 

Remark: Limits as the breaking probability a goes to 0. The limit of 71 as a —t- has 

twofold nature. It depends on the sign of the difference fi — (A + /3): 



y 2A 

lim 71 = 

"^0 ;3 + ^ + A - ^(/x- A-/3)2 



A 



A + /3 



if /i < A + /?. 
if /i > A + /?, 



Thus, to calculate the limits of the constants C^^\Up) and C^^\Down) as a — t- 0, we consider two 
cases separately: 



< A + /3 



lim G = A + /3 - /i, 

a— >-0 



lim 



11 — X 



lim C(^)([/p) 

a— >-0 



ji — \ 

A + /3 

lim C^^Vc/p) = 0, 



lim C7(i)(Z), 



(2) 



a-s-O 



own 



0. 



limJ(l) = A±^, 



lim d^\Down) 



0. 



Of course, from Proposition 12.11 we always have: 

i:{k, Up) 



lim lim 



Furthermore, if /.i < A + /3, then via ([2]) we have 

Corollary 2.2. Assume ^^ with p = 1 and < \ + (3. Then for Model 1 we have 

lim lim — ' , = 1. 

Note, that in this case limQ,_!.o7i = ^, thus (^)'^ is the asymptotic for the "limiting system". 

However, if ^ > A + /3, then limQ,_5.o 71 = but (^^)'^ is not a correct asymptotic, because both 

constants C^^\Up) and C^^\Down) have limits 0. In this case the asymptotic for the "limiting 
system" cannot be recovered from Proposition 12. 1[ 

However, using matrix geometric approach, we have the following result. 
Proposition 2.3. Assume ([T]j with p = 1 and ^> \ + (3. Then for Model 1 we have 

7r(fc, Up) ~ C^^\Up)-i'l + C{Up)-i^ 

and 



lim lim 



where 



7 



7r(/c, Up) 

fc-5>ooQ:->0 C{Up)j^ 

2A 

X + (3 + fi + a + y^' 



1, 



C{Up) > 0. 
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Note, that 7 and 71 differ only by the sign at ^/si and that for > A+/3 we also have limQ,_>o 1 = 

so that the asymptotic for small a is still {-)^ (we do not have any information about constant a 
CiUp)). 

Remark: Large deviation path. Propositions 12.11 and 12.31 suggest two different large deviations 
paths for small a. The way a large deviation path appears depends on the sign of the difference 
^-(A + /3): 

• For fi < X + (3 the most probable path leading to a big queue is to be more often in the Up 
status, and to accumulate a lot of customers, because service rate is not big enough. This is 
exactly the way it appears in standard M/M/1 queue. 

• For n > X + f3 the service rate n is big enough, so that large deviation path does not appear 
in the standard way: in this case the most probable situation is, that a lot of customers join 
the queue, when the server is almost entirely in the Down status. 

We illustrate this behaviour in Figure [3] below: The plots are for both cases: /i < A + /3 and 
/i > A + /3; X— axis is the step number, y— axis is the number of customers, 'dot' denotes that the 
server was in Up status and 'cross' denotes that the server was in Down status. For each case 
there are two plots: one with steps ranging from to 70000 and second with steps chosen in such 
the way, so that a large deviation path is well depicted. In case /u < A + /3 there is also depicted a 
line with slope of the large deviation path given by in ([U]). 



2.3 Results for Model 2 

For the general Model 2 with p E (0, 1) we have the following result about exact asymptotic, 
although we do not have knowledge about the constants. 

Proposition 2.4. Assume that ([7p holds. For Model 2 we have 

7r{k,y,Up) ~ C{Up,y)-f^, 
Tr{k,y,Down) ~ C{Down,y)^^^ 
where C{Up,y) > 0, C{Down,y) > 0. 

Remark: Limits as the breaking probability a goes to 0. The limit of 7p as a — )• has 

again twofold nature, it depends on the sign of the difference fJ-p — (A + 



1- 2A 

hm 7p 



0^0 



/3 + ^p + X- y^{fip-X-py 



— if /up < A + /3. 
HP^ 

— — if np> X + j3, 

x + p 



Unfortunately, we do not have any information about constants C{Up, y), C{Down, y). In particu- 
lar, we do not know if the limits of them are positive (in Model 1 in one case the constant C^^\Up) 
was positive, while in the other it was 0). It means that from Proposition 12.41 we cannot recover 
the asymptotic for the "limiting system". 

For Model 2 with p = 1 (which is the tandem of reliable and unreliable servers) we have the 
following exact asymptotic result. 
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Proposition 2.5. Assume that ([7P holds withp = 1. For the tandem system with unreliable server 
1 (i.e. Model 2 with p = 1) we have 



where 



C^'^\Up) 



7r{k,y,Up) 
7r(/c, y, Down) 

7(2) iA + /3-^-a + ^ 



C7(2)(c/p) 
C^'^\Down 



.(2) 



a 



d(^)G 



B = 1 



X + (3 + fi + a - y/sT 
2JI ' 



(i*-^^ is defined in il2\) and r]^'^^ is equal to rj in defined for appropriate process. 
Remark: Limits as the breaking probability a goes to 0. Note that C^^\Up), C^'^\Up), and 



own), C^'^\Down) differ only by a factor of B and or We can rewrite C^'^\Up) 



- — • B ■ C^^\Up) and similarly with C^'^\Down). Moreover, J*^^-* and d*-^^ are different, but 



they have the same limits as a 
of B, we have two cases: 



0. Thus, based on results for Model 1 and calculating the limit 



/i < A + /3 



0, 



lim B 

limCW(f/p) = 
lim C(2)([/p) = 0, 



lim 

a-s>0 



/i — A 



A' 



lim C(i)(Z). 



own 



^ > A + /3 



o->0 



lim B 

a-5-O 



lim C(2)(Down) 



0. 
0. 



^- (a + /3) 



lim C7(i)(;7p) 

a— >0 

lim C^^\Up) 

a— ^0 



A + /? 
C7 ' 



0, 
0, 



lim 

lim C(^)(Z)ou;n) = 0. 
lim C(^VZ)oii;n) = 0. 



It means that from Proposition 12.51 we connote recover the asymptotic for the "limiting system". 
For /X > A + /3 it is because limits of both constants C^^\Up) and C^^\Down) (and therefore 
C^'^){Up) and C^'^^Down)) are 0. In case fx < X + P although the limit of C^-^\Up) is strictly 
positive, the limit of C^'^\Up) is again 0, because of the limit of B. 



3 Proofs 

3.1 Uniformization and stability 

We find it more convenient to work with the embedded discrete-time Markov chain. We denote 
its kernel by P. Of course it has the same stationary distribution vr. We make uniformization by 
fixing some C such that C > \ + fx, + a + 13. 
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Lemma 3.1. Model 1 and Model 2 with p = 1 are ergodic if and only if X < ^j^/^- Moreover, 
condition A < -^^^fJ-p is sufficient for stability of Model 2 with p G (0, 1). 

Proof. 

• Model 1: 

If we order states in the following way 

{0,U) ^ {0,D) ^ (!,[/) ^ {1,D) ^ {2,U) ^ {2,D) ^ ... 



we can rewrite 



P2 Pi Po 

P2 Pi Po 

V 



(3) 



where 



,(0) 



g+A 

C 



C 



C 

_ x±i 
c 



R. n 

C ^ 







f X 


, Po= 1 




V 




a 


C 


C 



1 



I 
c 



1 



^ 

C 



A+/3 
C 



(4) 



Therefore P is quasi-birth-and-death process (QBD process) with inter-level generator 

^ 1 - - 

^ c 



G = Po + Pi + P2 



1 
c 



C 



Prom Neuts [9j (Theorem 3.1.1), we have that if inter-level generator matrix G is irreducible, 
then the process is positive recurrent if and only if 



• 



1 



< p-P 



2 • 



where p is the stationary probability vector of G. 
Wehavep= ^) , p • Pq • } ) = A • ^ and p • P2 • 



u • i which finishes 



the proof. 

• Model 2 with p = I: 

The server 2 is stable if and only if A < p. The output of server 2 is the Poisson process with 
intensity A (Burke's Theorem, see Burke [2] for details). In previous case we proved that 
unreliable server 1 with arrival rate A and service rate p is stable if and only if A < -^^^P- 
Of course the second condition implies first. 

• Model 2 with p £ (0, 1): 

Later, in Section 13.5.21 the harmonic function of the (so-called) free process is derived. By 



Proposition 13.21 it gives the following asymptotic (actually this was given in Proposition 12.4 
for any G N and a G {U, D} 

TT{k,y,a) ~ C{a,y)-fp. 
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It is enough to show, that A < ^j^/^p impUes X^/t ^(^' < °^ equivalently, that 7p < 1. 



It can be easily checked, that 7p < 1 if and only if A < ^^rrg/^p, thus this is a sufficient 



condition. 

□ 

Remark. Consider system similar to Model 2, but with 2 reliable servers (i.e. standard Jackson 
network) with service rate at server 2: ^2 = A* and service rate at server 1: /Ui = -^^^1-^ (which is the 
effective service rate of the unreliable server). Then, solving traffic equation and using standard 
stability conditions for Jackson networks, we have that the system is stable if and only if < 1, 

i-e- A < -^^^^i-p- It suggests that ([1]) is the necessary stability condition for Model 2 with p G (0, 1). 

3.2 Markov Additive Structure and result of Adan, Foley and McDonald |1] 

Tools used in this paper fall into the framework of Adan, Foley and McDonald [1], where Markov 
additive structure is needed. Let Zn = (X^,!^) be a Markov process with state space Z*^ x 
where Z = {...,— 2,— 1,0,1,2,...}. If the transitions are invariant with respect to the translations 
on a; G 2.^, i.e.: 

P((x, y), (x', y')) = P((0, y), (j;' — X, y')) for all x, x' G Z'^ and y,y'^£, 

then it is called a Markov additive process, X„ is its additive part, 1^ is a Markovian part. 

Processes Z^^^ and Z^^^ defined in Section [2. II are Markov additive if we remove the boundaries 
and let the transitions to be shift invariant relative to the first coordinate. Abusing notation, we 
denote state spaces of these processes with the same symbols, respectively, E^^'^ = Z x {^7, D} and 
^(2) = z X N X {U,D]. 

By harmonic function of Markov chain with transition matrix P we mean the right eigenvector 
h associated with eigenvalue 1, i.e. such that P/i = h. From [Ij we can deduce the following. 

Proposition 3.2. Consider Markov process {Xt}t>o with stationary distribution vr and state space 
E = {{k,A) : k £ A G Z"}. Let A G E and let K°° be the kernel of the free process, which is 
shift invariant relative to first coordinate. Let 

K{ik, A), {k', A)) = K°°{{k, A), {k',A))h{k', A)/h{k, A) 

be the kernel of so-called twisted free process, where h is the harmonic function o/K°°. // 

TT{k, A)h{k, A) < 00, (5) 

(A:,A)eA 

then 



d h{l,A), 

where d is the stationary horizontal drift and 



ri= Ax',A')h{x',A)n{x',A). (6) 



T-L{x', A) is the probability that twisted free process starting from (x', A) never hits {E\ A 
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3.3 Proof of Proposition 



3.3.1 The free process. 

We have to define A C E^^^ and a Markov additive process embedded in original one, so that it is 
shift invariant outside the boundary A. We want the process to be additive in the first coordinate 
and we want the second coordinate to be the Markovian part. Thus, as a boundary we can take 
A = {(0,Up) U {0, Down)}. Let us denote the transition kernel of this process by K°°. Being 



Markov additive in the first coordinate means 



c 

E 
C 

a_ 

C 

§_ 

C 

1 - 
1 - 



c 

C 



'{{m,a),{z + m,a')) = K°°((0, a), (z, a')), where 

for z = 1 and a' = a 
for z = —1 and a' = a = U 
for z = 0, a = U and a' = D 
for z = 0, a = D and a' = U 
for z = 0, and a' = a = D 
for z = 0, and a' = a = U 



Since we have removed the boundary, the free process walks over all Z x {Up, Down}. 



3.3.2 Feynman-Kac kernel 

With the free process we associate the following Feynman-Kac kernel: 
Kg{a,a') = ^K°°((0,^J),(z,^7'))e^^ where a,a' e {U,D}. We have 

z 

Kg has two eigenvalues 

h,2{0) :=^(c^-f -f -|-A + ^ + Ae^±^^(/ze-^-a-/3-M)2-4/./3(l-e-^)), 

We are interested in the larger eigenvalue, i.e. we only consider ki. We want the largest eigenvalue 
to be equal to 1, i.e. ki{9) = 1. Set: t = e^. It means 

C-^(« + /3 + /.)-A + | + At + ^y(^-a-/3-^)2-4/./3(l-i) = C. 
Equivalently, 

^(^i^-a-l3-fiy - 4^/3(1 - ^) = a + /3 + fi + 2X-^-2Xt (7) 

To find the solution of the above equation, we have to solve 

W{t) := X^t^ - X{P + a + 2X + + (A(a + 2/x + /3 + A) + n/3)t - fi{a + /3) = 0. (8) 
Of course W{1) = 0, thus 

W{t) = {t- l){X^t^ - X{P + a + X + ^j,)t + /i(A + /?)). 
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We obtain two solutions: 

X + /3 + fi + a + ^ X + /3 + n + a-^ 
= 2A ' = 2A • 

Note, that t2 = 7f^. We want the right hand side of d?]) to be positive, what is equivalent to 

2Xt'^ - (a + /3 + /i + 2X)t + /i < 0. 

However, one can check (noting, that si = (// + A + /3 + a)^ — 4//(A + that ti is not the solution 
of ([7]), because then the right hand side of the equation is negative. 



3.3.3 The harmonic function of the free process 

Lemma 3.3. The harmonic function of the free process is the following: 



h{x,U) 



h{x,D) 



1 



2/3 



71/ X + /3-fi-a + y/si 



Proof. We want to find the harmonic function for free process of the form h{z,a) = t^^^'', where 
t2 is such that the largest eigenvalue of Feynman-Kac kernel is equal to one, i.e. 

1 



h{z,a) = ^-j e'^". 
For h to be the harmonic function for free process we have to have 

V(z G Z) U), {x, (J))h{x, a) = h{z, U) and ^ K°^((z, D), (x, (T))h{x, a) = h{z, D). 

(10) 



First part of (jlOh means 



^K-((z,[/),(x,a))/i(x,a) 



A / 1 



C V71 



/X / 1 



C V71 



a 



e"^ + —tle^'' 



+ 1 



A + /i + a\ / 1 



C 



71 



e^" = h{z, U) 



and equivalently 



Al /X / A + /i + a 



71 



a 



Sd 



I.e. 



e^^ [A + /X + a - A— - /i7i] = ae^° . 
71 



Second part of (jlOl) means 



J]K-((z,I)),(x,I))Ma;,/) 



A / 1 



X,I 



C V71 



(^+1) 



C V71 



c y V71 



h{z,D) = e'^^ — 
.71 
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and equivalently 



A + /3 
C 



I.e. 



A + /3- A( — 

71 



Putting these conditions together we have: 

r e^^[A + Ai + a-AJ^ -^7i] 
I e^-[A + /3-AJ^] 



One of e^^ or e^^ can be arbitrary, set e^^ = 1. From [ii] we have 

_ /3 _ 2/3 



A + /3-A;i- A + /3-^-a + ^ 



□ 



3.3.4 The twisted free process. 

With the harmonic function of the free process we can define the /i-transform (or twisted kernel) 
in the following way: /C((m, a), (z + m, a')) = /C((0, a), (z, a')) = K°°((0, cj), (z, a')) 



/i{0,(t) 



I.e. 



/C((0,a),(z,a')) 



( A K\,U) 
C h{Q,U) 




1 X+j3+n+a-^ 
^ C 2 




for 


z 


= 1 






fi h{-l,U) 




_ 1 2Aft 




for 


z 




1 and a = a' = 


U 


C h{0,U) 




~ C A+/3+/x+a-^ 


AT 




a h{0,D) 




_ 1 2a/3 




for 


z 


= 


a = U and a' 


= D, 


C h{0,U) 




C X+l3-ti-a+^ 




' P h{0,U) 




1 A+/3-/i-a+^ 


AT 


for 


z 


= 


a = D and a' 


= u, 


C h{0,D) 




^ C 2 




(1-^) 


h(0,D) 
h{0,D) 


_ 1 A+/3 
- ^ C 




for 


z 


= 


and a = a' = 


D, 


f 1 A+a- 

[ V c 


f/i\ h{0,U) 
J h(0,U) 


1 A+a+/^ 
~ ^ C 




for 


z 


= 


and a = a' = 


U. 



The transition diagram is simply a reweighting of the transitions in Figure [TJ 

Now we are interested in the stationary distribution of the Markovian part of the twisted free 
process, call it /C2, which state space is {U,D}. We have: 



K.2iU,D) 

K2{U,U) 
1C2{D,D) 



KiiO,U),iO,D), 
K{{0,D),{0,U), 
/C((0,i7),(0,C/), 

k:((o,z)),(o,d) 



+K{{0,U),{-1,U))+ K{{,U),{1,U) = I-/C2 
+KiiO,D),il,D)) =l-K2{D,U). 



For 2-states Markov chain with transition matrix 



1 - Pi Pi 
Pi I-P2 

is 7r(l) = P2/{pi +P2), vr(2) = 1 - 7r(l) = pi/{pi +^2)- 



the stationary distribution 
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Let (/J be the stationary distribution of /C2. We have 

K2{D,U) 



K2{D,U) + K2{U,D)' 
Note that G = C{K2{D, U) + K2{U,D)) and rewrite 



K.2iU,D) 



K2{D,U)+K2{U,D)' 



nU) = -Q^2{D, U) = - , 

u?(D) = -K2(U,D) = . 

Next we have to compute the stationary horizontal drift of the twisted free process: 

= ip{U)[Kiix, U),ix + 1, U)) - K{ix, U), (x - 1, [/))] + ip{D)Ki{x, D),{x + 1, D)) 



1 X + l3 + fi + a- ^/s^ 
C 2 



{viU) + ip{D))-^{U) 



2A/i 



C X + p + H + a- ^ 
2Xfi 



1 A + /3 + /X + a - -y/sl 1 1 X + P - n - a + ^/s^ 
C 2 ~g"C 2 + M + a 

_ 1 /A + /3 + /i + a - -y/sl 1 A + /3 - /i - a + 

~C\ 2 g' ^' X + (3 + ti + a-^) • 



(11) 



The assertion of Proposition [2?T] fonows from the Proposition [321 because condition ([5]) is obviously 
fulfilled, since the boundary A consists only of two states. 



3.4 Proof of Proposition 12.31 

We use the matrix geometric approach following Neuts, [9]. For a discrete time QBD process 
as one given in ([3]), Theorem 1.2.1 of Neuts implies that 



7r{k,Up) = W2 (e^^^ + ws 



where e^^ > e^^ are the eigenvalues of matrix R described below. Note that 62, 0^ and W2,ws 
depend on a. For any ti;2 > we have that for k big enough the term (e^^)^ dominates (e^^)^. 
However, when a — )• 0, then W2 ^ (see Remark on page[5|), so that W3{e^^)^ is the leading term. 

m ri2 



For matrices P2,Pi,Po defined in (jS.ip we want to find a matrix R 



r2i r22 



fulfilling 



R = R^Po + RPi + Pn 



We have: 



I.e. 



(l?i±I12l2il,, 
C ^ 

(r2iril+r22r2i) 



R2P2 + RPi + Po 





c 






r\2 




_ r2i 


r22 







fi . 



+ 



rii ( 1 - 



+ 



T12P 
c 



^+ri2(l 



A+/3 
C 



r2i 1 



c 



+ ^ ^+r22(l-^ 



c 



^•12/3 



+ 



^+r-i2(l 



(rgmi+r™) ^ + r21 (1 - ii^) + ^ ^ + r22 (l " ^) + 



(' 



C 



C 



13 



One can check that the solution is 



R = 



A a\ 
Jl /i(A + /3) 
A (a + /i)A 



A 



1 



1 



X + 13 
a + fi 



a 



I ^^ (A + /3)/i J 



A + /3 J 



Eigenvalues of R are 



e 



A + /i + a + /3 + y/sT A 



2(A + /3) "/i 
A + ;U + a + /3 - ^/sT A 



2(A + /3) "/i 



It is easy to check that e^^ = 71 (what we already have had) and e^^ = 7. Now, as a —t- we 
have W2 ^ and thus liuia-^QW^ > (because both limits cannot be equal to 0). The leading 
term is ws{e^^)'', thus the asymptotic of TT{k,Up) is C{Up)'y^, where C{Up) = w^. This finishes 
the proof. 

Remark. Note, that this method does not give us constant W3 (nor W2, but we already have it, 
it is C{Up)). 

Remark. While looking for parameter 9 in Section 13.3.21 for which the largest eigenvalue of the 
Feynman-Kac kernel is equal to 1, we encountered equation This equation has two solutions: 
ti and t2 given in ([9]). It turns out, that ti is not the solution for Feynman-Kac kernel, because 
the right hand side of ([7]) (and ([8]) is simply obtained from ^ by squaring both sides) is negative. 
However, t2 is exactly the second term in spectral expansion of vr, what we derived in Section 
13.41 using matrix geometric approach. We conjecture that this can always be the case for QBD 
processes. 

3.5 Proof of Proposition 12.41 

The asymptotic without constants is obtained via Proposition 13.21 by calculating the harmonic 
function of the free process and by verifying that condition ([5]) , what is done in Section 13.6.21 

3.5.1 The free process. 

For Model 2 as the boundary we can take A = {(0,y,a),y G N, cr G {Up, Down}}. Then the pro- 
cess outside A is shift invariant relative to first coordinate. Define free process K°°((m, y, a), (z + 
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m,y',a')) = K°°((0, y, a), (z, y', a')), where 



K^iiO,y,a),iz,y',a')) = { 



X 

c 




for z 


= 0, y' 


= y + 1, cr' = (7 








for z 


= -1, 


y' = y and a' = a = 


U 




-P) 


for z 


= -1, 


y' = y + 1 and o"' = 


a = U 


c 




or z -- 


= 1, y' 


= y — 1 > and cr' = 


= a 


a 




for z 


= 0, y' 


= y, a = U and cr' 


= D 


C 




for z 


= 0, y' 


= y, a = D and cr' 


= U 


1 - 


c 


for z 


= 0, y' 


= y = and u' = u 


= D 


1- 


A+/i+a 
C 


for z 


= 0, y' 


= y = and a' = a 


= U 


1- 


A+/i+/3 
C 


for ^; 


= 0, y' 


= y > 1 and a' = a 


= D, 


1- 


X+2ij.+a 
C 


for z 


= 0, y' 


= y > 1 and a' = a 


= U. 



After removing the boundary, the free process walks over all x N x {Up, Down}. 

3.5.2 The harmonic function of the free process 

Lemma 3.4. The harmonic function of the free process is following: 



I \ x+y / 1 \ ^"""^ 

h{x,y,U)=[-] , h{x,y,D) = l-) —— 



2/3 



Proof. For the free process we want to find the harmonic function of form h{x, y, a) = eP^^eP'^VeP" 
For h to be the harmonic function for free process we must have 

V {yeN,ae{U,D}) K~((0, y, a), (x', y', a'^x', y', a') = ^0, y, a). 

x',y',a' 

For y = 0, cr = [/ we have 

K-((0, 0, [/), (0, 1, U))h{Q, 1, U) + K-((0, 0, U), (-1, 0, U))h{-1, 0, U) 

+K-((0, 0, U), (-1, 1, U))h{-1, 1, U) + K-((0, 0, [/), (0, 0, D))h{Q, 0, D) 
+K°°((0, 0, U), (0, 0, U))h{0, 0, U) = /i(0, 0, [/), 



I.e. 



e^^ [A + /X + a - Ae^2 



a 



o 



-^1 



Upe - - p)e-^^e'^^\ = ae^'' 



Similarly, considering cases y>l, a = U; y = 0,a = D and y > l,cr = D we obtain following 
four equations: 

e'^'^ [X + 2fj, + a- Ae^2 _ ^^e^^i - /^(l - p)e-^ie-^2 _ ^g^ig-^a] = Q,gei3 ^ 
e^o[A + /3- Ae^2] = ^g^t/^ 

e^«[A + /x + /3- Ae^2 _^geig-e2] = ^g^c/^ 
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First two imply that e^^ = e^^ and then last two are equivalent. We are left with 2 equations and 
3 variables, thus we can set e^^ = 1. Denoting t = e^^(= e^^) we have 

A + /i + a — At — ^ipj — fi{l — p) = ae^° , (i) 
A + /3-At = ^. (ii) 

Comparing e^^ from both equations we have 

A + ^ + Q — At — fipj — — p) /3 



a A + /3-At' 

(A + ^ + a - At - fipj - - p))(A + /3 - At) = a/3. 
Multiplying both sides by t and noting that t — 1 is one of the solutions, we can rewrite it as 

(t - l){X^t'^ - \{fip + A + a + /3)t + fipiX + /?)) = 0. 
Recall that Sp = {fip — A — /3 — a)'^ + Aafip. The solutions are 

/xp + A + a + /3 + ^/s^ fj,p + X + a + f3 - ^/s^ 

*i = ^T"; ' *2 



2A ' 2A 

Noting that Sp = {fxp + A + /3 + a)^ — 4^p(A + /3), it can be easily check ti > 1 <;=^ A > -^^fJ-p 
and t2 > 1 <^=^ A < -^^^^J-p, i.e. only t2 (which is equal to is a valid solution. 
From (ii) we have 

Jo _ _ 2/3 



A + /3 — At2 X + P — ij.p — a + 



□ 



3.6 Proof of Proposition 12.51 

Since Model 2 with p = 1 is the special case of general Model 2, we already have the harmonic 
function given in Lemma |3.4[ We can proceed with the twisted free process. 
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3.6.1 The twisted free process. 

Define the twisted kernel in tlie following way: K.{{m, y, a), {z+m, y' , a')) = /C((0, y, a), {z, y' ,a')) 
W-my,a),M,a'))^-^ 



( A h{0,y+l,a) 
C h(0,y,a) 

IX hi-l,y,U) 
C h{0,y,U) 

H h{Q,y,a) 
C hi-l,y+l,a) 

a h{0,y,D) 
C h{0,y,U) 



= < 



h{0,y,U) 



C 



1 



2 



C A+/9+M+a— v/sT 



J± 

C 

1 



2afS 



C h{0,y,D) 


~ c 


(1- 


C )h{0,0,D) 


= 1 


(1- 


X+H+a\h(0,0,U) 
C )h{0,0,U) 


= 1 


(1- 


C )h{0,0,D) 


= 1 


(1- 


X+2ij,+a\h{0,0,U) 
C I h{Gfl,U) 


= 1 



C X+li-ii-a+yfll 
1 X+P-fi-a+^/si 



x±i 
c 

X+n+a 
C 

A+M+/3 
C 

X+2ii+a 
C 



for 


z — 


n 
•J) 


1/ — 

y — 


y + I, a' — a, 




for 


z — 




J-) y 


— y dillLl (J — o — 


TT 


for 


z = 


1, 


y' = 


y — 1 > and a' 


= o; 


for 


z = 


0, 


y' = 


y, a = U and a' 


= D, 


for 


z = 


0, 


y' = 


y, a = D and a' 


= u, 


for 


z = 


0, 


y' = 


y = and a' = a 


= D, 


for 


z = 


0, 


y' = 


y = and a' = a 


= u, 


for 


z = 


0, 


y' = 


y > 1 and a' = a 


= D, 


for 


z = 


0, 


y' = 


y > 1 and a' = a 


= U. 



The transitions of twisted free process are reweighted transitions of the free process. 

We are interested in the stationary distribution of the Markovian part of the twisted free process, 

call it /C2, which state space is N x {[7, D}. 

Denote: 



, 1 A + /3 + /X + a - -Vsl , fi , 
A =— — ,)U =— ,a = 



C 2 
The transition of K2 are 



C" 



C \ + 13 - 11- a + ^ 



,/?' = 



1 \ + P — jj, — a + -y/sl 
C 2 ■ 



K2{{y,cT),{y\a')) 



A' 




for 


y' 


= y + 1 and a' = 


-- 0; 








for 


y' 


= y — 1 > and 


a' 


= 


a' 




for 


y' 


= y, (J = U and 


a' 


= D, 


/3' 




for 


y' 


= y, a = D and 


a' 


= u, 


1 - 


(A' + Ai' + a') 


for 


y' 


= y > 1 and a' = 


= a 


= u, 


1 - 


{x' + ii' + n 


for 


y' 


= y > 1 and a' = 


= a 


= D 


1 - 


(A' + a') 


for 


y' 


= y = and a' = 


= a 


= u, 


1 - 


(A' + /3') 


for 


y' 


= y = and a' = 


= a 


= D 



The stationary distribution of K2 is given by: 



' \'\y 

ip{y,U) = B-{- 



^iy,D) 



a 



a' + 



B 



^_ V _ ^ A + ^ + /x + a-Vi 



2/x 



Marginally K.2{y, •) is a birth and death process with birth rate A' and death rate the stationary 
distribution of it is geometric: probability of having k customers equals to Bi {Bi is a 
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normalisation constant). Similarly, /C2(-,o") is a Markov chain with two states, the stationary 
distribution of which is: -^^r^ of being in Up and ^, of being in Down status. Process K.2{y, cr) 
is not a product of its marginals, but its stationary distribution is of a product form. This can be 
checked directly, for example for y > 1 we have: 

^{y, u) = Y, v>{y', <y')K-2({y\ cr'), (y, U)) 



smce 



(^(y, U) = ^{y - 1, U)K2{{y - 1, U), (y, U)) + ip{y + 1, U)K2{{y + 1, U), (y, U)) 
+(^(y, D)K2{{y, D), (y, U)) + ^{y, U)K2{{y, U), (y, U)), 
ifiy, U) = vp(y - 1, U)>! + ip{y + 1, U)^l' + ip{y, D)P' + (^(y, U){1 - (V + ^' + a')), 
V9(y, C/)(A' + /i' + a') = ^{y - 1, [/)A' + (^(y + 1, U)^l' + ^{y, D)(3', 



/3'(A' + ^' + a') = + ^/3V' + a'/3', 

A n 

+ + a') = P'{\' + + a'). 
Next we have to compute the stationary horizontal drift of the twisted free process: 

(^(0, U) [0 - /C((0, y, [/), (-1, y, C/))] + ^^=1 ^C^' ^) [^((0' 2^' f^)' (1' ^ " 1' ^)) " ^((0' U), (-1, y. 



+ 5^ </p(y, I))[/C((0, y, I)), (1, y - 1, D))] 

y=l 



ip{0,U) 



2A/i 



CA + /3 + /i + a-^ 



+ 



/i 1 



2A/i 



C CA + /? + ^ + Q- ^ ^-^ 1 



C 



OO OO \ 

J2viy,U) + Y,v{y,D)\ -- 



2A/i 



C A + /? + ^ + a - ysl 
/3' 



A' 



Wehave^(/.(y,[/)+j;(^(y,I)) = 1-V9(0, [/)-^(0, D) = l-^.-^-i?.-^ = = _ 



and (^(y, C/) = — — ■. Using the definitions of a' and /3' we arrive finally at 

^ a' + p 

?/=o 



= - 
C 



1 /A + ^ + /3 + a - y/sl 



2A/i(A + /3 - /i - a + 



(A + /3 + ^ + Q- ^)(4a/3 + (A + /3-/i-a + ^) 



(12) 

Now we make use of the Proposition 13.21 We postpone verifying the condition ([5]) to Section [3.6.21 
In our case A = {(y, cr), y e N, a € {t/, 
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For a = U we have 

Noting that ^71 = ^ and G = ^(a' + /3') we have 



^, ,i - ^ ^^^^ - c 



J/ 



Similarly for a = D we have 



3.6.2 Verification of the assumption of Proposition 13.21 

For Propositions 12.51 and 12.41 to hold, condition ^ must be verified. We show this for a general 
p G (0, 1]. We consider similar network to Model 2, but we do not allow a customer to join the 
queue at server 1 when the server is in Down status; in this case customer is rerouted again to the 
queue at server 1. This is a case of unreliable network with rerouting ("the loss regime", customer 
is lost to server in Down status, but it is not lost to the network) introduced by Sauer and Daduna 
(see Sauer, Daduna [11] or Sauer |10j). Namely, when server is in Up status it operates as classical 
Jackson network, but when it is in Down status the routing is changed, so that with probability 
1 customer stays at server 2. This is so-called RS-RD (Random Selection - Random Destination) 
principle for rerouting. They showed, that then the stationary distribution (say vr^'^^) is a product 
form of the stationary distribution of pure Jackson network and of the stationary distribution of 
being in Up or Down status. For the above introduced system, the traffic equation is: 

m=mi r?2 = A + r/i(l -p). 

The solution is 771 = 772 = ^- Finally, 



vr(^)(x,y,^p)=C(^).fAy'^, n(')i^,y,Down) = C('^.(^y ' " 



x+y 

a + /3' 

where C^^^ is a normalisation constant. It also can be checked directly, that the above is the 
correct stationary distribution, by checking that balance equation holds. 

Described network differs from Model 2 only by one movement: for x > and y > there is 
a possible transition from {x,y, Down) to (x + l,y — l,Down) for Model 2, but there is no such 
transition in the above model. Obviously, the stationary distribution 7r('^)(0, •, o") is stochastically 
greater then 7r(0,-,(T), the stationary distribution of Model 2. This can be seen for example by 
constructing a coupling such that both networks move in the same way, whenever it is possible 
(when one of the processes is to make forbidden transition - like leaving the state space - it 
makes no move then), except one transition: when process of Model 2 goes from (x,y, Down) to 
{x + l,y — 1, Down), then the other makes no move. 

Now, for Model 2 as boundary we have A = {(0, y, o") : y £ N,cr G {Up, Down}} and the 

harmonic function (given in Lemma l3.4p is h{x,y,a) = C{a) (— j .In the condition ([5]) we 
have: 

00 00 

^{^: A)h{x, A) = Y, ^(0, y, U)h{0, y,U)+J2 ^(0, V, D)h{Q, y, D) 
(a;,A)eA y=0 y=0 
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=: E^[h{0, Y, U)] + E^[h{0, Y, D)] < [h{0, Y, U)] + [h{0, Y, D)] 



since h is increasing w.r.t. second coordinate and 

7r(0, ■,a) <st iT^^\0, ■,a), a £ {Up, Down}. 



And for vr^"^) we have 



oo 




oo 




4^) m Y, u)] + ) m y, D)] = ^ 



y=o 



y=o 



with appropriate constants ci and C2. Of course it is finite if — < 7p. It can easily be checked, 
that it holds for any set of parameters. Thus, the condition ([5]) holds. 
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o 1 ^/-?-— ^7" --i^ , . , , , , , , . . , , . , , ^ 

Steps : from 54550 to 57000 
a)/i<A + /3: a = 0.1,/3 = 10, A = 10,/i = 11. 



Steps : from to 70000 




Steps : from 58500 to 61000 
h)ii>X + l3: a = 0.01,/3 = 1,A = 20,Ai = 60. 



Figure 3: Two different large deviation paths 
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